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On the Approximate Weak Chebyshev Greedy 
Algorithm in Uniformly Smooth Banach Spaces 

A. V. Dereventsov 


Abstract 

We study greedy approximation in uniformly smooth Banach spaces. 
The Weak Chebyshev Greedy Algorithm (WCGA), introduced and stud¬ 
ied in [Q, is defined for any Banach space X and a dictionary D, and pro¬ 
vides nonlinear n-term approximation with respect to T>. In this paper we 
study the Approximate Weak Chebyshev Greedy Algorithm (AWCGA) - 
a modification of the WCGA that was studied in [3- In the AWCGA 
we are allowed to calculate n-term approximation with a perturbation in 
computing the norming functional and a relative error in calculating the 
approximant. Such permission is natural for the numerical applications 
and simplifies realization of the algorithm. We obtain conditions that are 
necessary and sufficient for the convergence of the AWCGA for any ele¬ 
ment of X. In particular, we show that if perturbations and errors are 
from h space then the conditions for the convergence of the AWCGA 
are the same as for the WCGA. For specifically chosen perturbations and 
errors we estimate the rate of convergence for any element / from the 
closure of the convex hull of T> and demonstrate that in special cases the 
AWCGA performs as well as the WCGA. 

Keywords: Banach space; nonlinear approximation; greedy algorithm; 
Weak Chebyshev Greedy Algorithm; Approximate Weak Chebyshev Greedy 
Algorithm. 


1 Introduction 

This paper is devoted to the problem of greedy approximation in Banach spaces. 
This problem was extensively researched by V. N. Temlyakov (see, for instance, 
E] , H, 0 ) ■ For the Weak Chebyshev Greedy Algorithm (WCGA) in uniformly 
smooth Banach spaces, the sufficient conditions for convergence and the rate 
of approximation were obtained in El- In this article we study the Approx¬ 
imate Weak Chebyshev Greedy Algorithm - the modification of the WCGA 
with perturbations in computing the norming functionals and relative errors in 
calculating the approximants. This algorithm was analyzed in [7] and the suf¬ 
ficient conditions for convergence and an estimate for the rate of convergence 
in a special case were obtained. In this paper we apply the technique used 
in [7]. We prove weaker sufficient conditions for convergence, show that they 
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are sharp, obtain an estimate for the rate of approximation, and compare them 
with known results. 

This paper is devoted to the Banach space setting. Let X be a real Banach 
space. A dictionary is a set V of elements from X if ||c/|| = 1 for each element 
g G T> and spanD = X. For convenience of notations we consider symmetric 
dictionaries, i.e. such dictionaries that g G V implies —g G V. By Aq(V) we 
denote all the linear combinations of the elements of a dictionary T>, and by 
A\(V) we denote the closure of the convex hull of a dictionary V. 

For any non-zero element f € X let Ff denote a norming functional of /, i.e. 
such a functional that \\Ff\\ = 1 and \\Ff(f)\\ = ||/||. The existence of such a 
functional is guaranteed by the Hahn-Banach theorem. 

A weakness sequence { t n is a sequence of real numbers t n such that 0 < t n < 1 
for any n > 1. A perturbation sequence {Anj^Lo a sequence of real numbers 
S n such that 0 < 6 n < 1 for any n > 0. An error sequence {rin}n Li is a sequence 
of real numbers r] n such that rj n > 0 for any n > 1. By rjQ we denote the least 
upper bound of {r?n}^l r 

For a Banach space X , a dictionary T>. and an element / G X , the Approxi¬ 
mate Weak Chebyshev Greedy Algorithm (AWCGA) with a weakness sequence 
{t n }^Li, a perturbation sequence {An}^Lci’ an< ^ an error sequence {rj n is 
defined as follows. 


Definition (AWCGA). Set fo = f and for n > 1 

1. take any functional F n _\ satisfying 

H^n-ill < 1 and F n -!(/„_!) > (1 - <S„_i) ||/„_i||; (1) 

and find any <f> n G T> such that 

F n -i{4> n ) > t n supF n _i(g); (2) 

3 er> 


2 . 


for = span{^}" =1 
satisfying 


denote E n = inf ||/ — G|| and find any G n G 

Ge$„ 


11/ - Gn|| < (1 + Vn)E n ; 


( 3 ) 


3. set fn = f -Gn 


Note that if the supremum is not attained, one can select t n < 1 and proceed 
with the algorithm. In particular, if t, n < 1 for any n then the AWCGA can 
be realized for all Banach spaces and all dictionaries. Moreover, there might 
be several elements satisfying conditions © ©, so the algorithm does not 
guarantee uniqueness of realization. We say that the AWCGA converges if 
\\.fn\\ —>• 0 for any realization of the algorithm. Conversely, the AWCGA diverges 
if there exists such a realization that ||/„|| 0. 

Recall that a Banach space is smooth if for any non-zero / the norming 
functional Ff is unique. For a Banach space X the modulus of smoothness p(u) 
is defined by 


p{u) 


sup 

M=IMI=i 


\\ x + u y\\ + \\x 

2 


uy || 


( 4 ) 
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A Banach space is uniformly smooth if p(u) = o(u) as u —> 0. We say that the 
modulus of smoothness p(u) is of power type 1 < q < 2 if p(u) < 'ju q for some 
7 > 0. It follows from definition Q that every Banach space has a modulus 
of smoothness of power type 1 and that every Hilbert space has a modulus of 
smoothness of power type 2. Denote by V q the class of all Banach spaces with 
the modulus of smoothness of nontrivial power type 1 < q < 2. In particular, 
it is known (see Lemma B.l from ED that the modulus of smoothness p p (u) of 
L p space satisfies 


p p {u) < 


f u p 1 < p < 2 
u 2 2 < p < oo 


hence L p G V q , where q = min{p; 2}. 

We study approximation in uniformly smooth Banach spaces. The reason 
for such restriction is supported in [3], where it is shown that convergence of 
a nonlinear approximation strongly depends on the norm smoothness of the 
space, and that if a space is not smooth, the convergence of incremental greedy 
approximation cannot be guaranteed for all elements / from X (Theorem 3.1); 
however, if the space is uniformly smooth, the convergence is guaranteed for 
all elements / from X (Theorem 3.4). Additionally, it is shown in [4] that 
the smoothness of a space is required for the convergence of the WCGA. For 
completeness, we prove this result in Proposition Q] from section [2] 

We note, however, that the uniform smoothness of a space is not a necessary 
condition for the convergence: it is shown in [2] that if X is a separable reflexive 
Banach space, then X admits an equivalent norm for which the WCGA con¬ 
verges for all dictionaries T> and all elements / G X (see Theorem 2.6 from HD- 
On the other hand, spaces which admit an equivalent uniformly smooth norm 
are precisely super-reflexive spaces (see e.g. 0)- Therefore, any separable re¬ 
flexive Banach space A", which is not super-reflexive, admits an equivalent norm 
for which the WCGA converges for all dictionaries and elements; however, this 
norm would not be uniformly smooth. An example of a separable reflexive but 
not super-reflexive Banach space can be found in p]. 

The goal of this paper is to establish sufficient and necessary conditions 
for convergence of the AWCGA for all uniformly smooth Banach spaces with 
the modulus of smoothness of a nontrivial power type, all dictionaries, and 
all elements of the space. We understand the necessity of a condition in the 
following sense: if the given condition does not hold, there exists a Banach 
space X G V q , a dictionary T >, and an element / G X such that there is a 
realization of the AWCGA of / that does not converge to /. 

We start with the known result, which states the sufficient condition for the 
convergence of the WCGA (see Corollary 2.1 from [6]). 


Theorem A. Let X G V q be a Banach space and T> be any dictionary. Let 
{t n }^ =1 be a weakness sequence. Assume that 


^2tP=oo, (5) 

n=1 
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where p = q/{q — 1). Then the WCGA converges for any f £ X. 

It is shown (see Proposition 2.1 from [B]) that condition ([5]) is sharp, i.e. 
Theorem El gives necessary and sufficient conditions of the convergence of the 
WCGA for all Banach spaces X £ V q , all dictionaries T>, and all elements f £ X. 

The next result states the sufficient condition for the convergence of the 
AWCGA (see Corollary 2.2 from [7]). 

Theorem B. Let X £ V q be a Banach space and T> be any dictionary. Let 
{tn}^ = i be a weakness sequence, {<5„}^L 0 be a perturbation sequence, and {r]n}^Li 
be a bounded error sequence. Assume that 

OO 

= °°’ 

n= 1 

Sn = 0(t P n+1 ), 

Vn = o(t P ), 

where p = q/(q — 1). Then the AWCGA converges for any f £ X. 

This paper proposes that we weaken conditions (HI) © by imposing them 
only on subsequences. We show that in this case the specified conditions are 
necessary for the convergence of the AWCGA. The following theorem is the 
main result of this paper. 

Theorem 1. Let {f n }“^ be a weakness sequence, {An}^L 0 be a perturbation 
sequence, and {rj n }'ff =l be a bounded error sequence. Then the AWCGA con¬ 
verges for any Banach space X £ V q , any dictionary V, and any element f £ X 
if and only if there exists a subsequence {nk}kLi such that 


OO 


ECi = o °- 

(9) 

k =1 


= o(t P Uk + 1), 

(10) 

Vn k = o(t P nk + 1 ), 

(11) 


( 6 ) 

(7) 

( 8 ) 


where p = q/(q — 1). 

The particular advantage of this subsequence approach is that once a sub¬ 
sequence {nk}^L 1 satisfying conditions © (fill) is found, only the choice of el¬ 
ements (f> nk is essential for convergence, so arbitrary elements <pj can be chosen 
on other steps. 

In the special case t n = t > 0 for all n > 1, Theorem m provides that 
the condition lim (S n + rj n ) = 0 guarantees the convergence of the AWCGA. 

n—>• oo 

Theorem [1] shows that in this case the weaker condition lim inf (5„ + rj n ) = 0 

n—>oo 

is a necessary and sufficient condition for the convergence of the AWCGA, i.e. 
the following theorem holds. 
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Theorem 2. Let {in}^Li be a weakness sequence with lim inf t n > 0, 

n—too 

be a perturbation sequence, and {r]n } n= i be a bounded error sequence. Then the 
AWCGA converges for any Banach space X £ V q , any dictionary T>, and any 
element f £ X if and only if 


lim inf (S n + rj n ) =0. 

n—too 

Note that by using weaker restrictions on the modulus of smoothness and 
by applying the technique from Theorem 2.2 from [7j, the previous theorem can 
be stated for any uniformly smooth Banach space. 

Combining Theorem |T| with Lemma [5] proven in section [2] we obtain the 
following theorem, which states that necessary and sufficient conditions of the 
convergence of the AWCGA in case when perturbation and error sequences are 
from £i space, are the same as for the WCGA. 

Theorem 3. Let { t n }™—i be a weakness sequence, {<5 n }^Lo £ l\ be a pertur¬ 
bation sequence, and {T]n}^Li £ £i be an error sequence. Then the AWCGA 
converges for any Banach space X £ V q , any dictionary D, and any element 
f £ X if and only if 

OO 

tP n = 

n= 1 

where p = q/(q — 1). 

We note that with the minor changes in the proof of Theorem [Bj condi¬ 
tion © can be replaced with rj n = o(t p n+1 ). It is easy to see that this modified 
version follows from Theorem [l] In section [2] we show that Theorem Q] implies 
the unmodified version of Theorem [B] as well. 

2 Convergence of the AWCGA 

First, we justify the restrictions imposed on a Banach space X. The following 
proposition shows that if X is not smooth, then for some dictionary T> and 
some function /, the WCGA of / does not converge even if / is a finite linear 
combination of the elements of the dictionary. 

Proposition 1. Let X be a nonsmooth Banach space. Then there exists a dic¬ 
tionary T> and an element f £ Aq(T>) such that WCGA of f with any weakness 
sequence does not converge to f. 

Proof. Since X is not smooth, there exists an element / from the unit sphere of 
X with two norming functionals F and F' such that F ^ F'. Then there exists 
an element g £ X such that F(g) ^ F'(g). Without loss of generality assume 
that F(g) > F'{g). Denote 

F (g) + F (9) and = ai {g - F(g)f) , (12) 


Jo = «o J 
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where = 


F(g)+F'(g) 


and «i = ||g — F(g)f\\ 1 . Note that F(g 0 ) > 0 


and F'(go) < 0. Let be a dictionary in X. Consider the set of indices 


A' = \j £ A : e,- - 


F( ej ) 


3 F(g 0 ) 


9o ^ 0 ^. 


Define for any j £ A' 


e 'i = Pi e i - 


F( e j) 


^ F(g 0 ) 9 °)' ™ ^ F(g o y 

We claim that V = {±go, ± 51 } U {±e'} je a' is a dictionary as well. Indeed, take 


where /3,■ = 


F(ej) 

e-i - \ go 


(13) 


any h £ X and pick any e > 0. Then, since 


coefficients {aj}j & a such that 


h ~ E a o e i 

je a 


l e j}jeA is a dictionary, there exist 
< e. Since 


X! a 3 e i = X a i [Pi ' e j + 

ieA jeA' v 




5o 


= x« 

A 

_ J’(fe) 

•^(50) 


J ^(5o) 


^(5o) 

5o+ X 


X 

je a\a 


F(e 3 ) 

j F(g 0 ) 90 


a. 


l e ' 


5o + X ^ e ' 


’J 


jGA' 


Pi ~ 3 ' 


then h € spanX>, and 2? is a dictionary. Note that / S span{< 7 o, 5 i}, and thus 
/ € Aq(T>). However, we claim that element go does not approximate /, i.e. 


argmin \\f - g,g 0 \\ = 0. 

Indeed, for any fi > 0 

11/ + M5o|| > F(f + figo) = 1 + fiF(go) > ||/|| , 

11/ - M5oll > F’(f - fig 0 ) = 1 - /jF'( g 0 ) > ||/||. 

Additionally, the choice of the elements (fl2ll and (fl3l) of the dictionary V pro¬ 
vides 


F(go) > 0 , 

F(gi) = 0, 

F(e'j) = 0, for any j £ A'. 

Then consider the following realization of WCGA of /: for any n > 1 choose 
F„_i = F, (f> n = go , and f n = /. Hence ||/„|| -/> 0 and WCGA does not 
converge. □ 
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Next we demonstrate that assumptions of Theorem [T| are weaker than the 
ones of Theorem E Assume that conditions (101) (1 K [) hold. Then condition ( 11 () I) 
holds for any subsequence {nk}^ =1 . The following lemma shows that condi¬ 
tions © and © imply conditions © and (fill) with some subsequence {fifcj-^L-p 

Lemma 1. Let {a n }^Li and be any such nonnegative sequences that 

OO 

b n — oo and a n = o(6„_i). 

n =1 


Then there exists a subsequence such that 

OO 

Y, b nk = oo and a Uk = o(b nk ). 
k =1 

Proof. We claim that there exists a subsequence {rife}^° =1 such that 

^ OO 

- and b n k = oo- 


bnu — 1 2 


k =1 


Indeed, let A C N denote the set of all such indices A E N that 

<i 


b\~i 2 


(14) 


Then A = (J Awhere (Afc} fe=1 are disjoint connected subsets of A (i.e. if 
fc=l 

£ A k, then for any A £ N such that pi < A < /X 2 , A £ A k) for some 

AC £ N U loo). For each k £ [1; N] define A k = min {A £ Afc} - the minimal 

agn 

N 

element of the set A k - and consider the sum b\ k . 

fc=l 
N 

If (T) b\ k = oo, take {nk}^° =1 = {Afc — l}j£L 2 . Note that in this case N = oo and 
fc=l 

the sequence {Afc})E 2 (and therefore {rifcjfcLr) is defined correctly. It follows 
from the definition of Afc that Afc — 1 ^ A, hence conditions (THl) hold for the 
sequence {nk}kLi- 

N 

If E K < oo, then note that for any A £ Afc the definition of the set A implies 
fc=l 

b\ < 2 -( x ~ Xk ' > b\ k . Hence 


N AT | A fc | N 

= 2 ~ {j ~ 1)b a, < 2 Y b ^ < oo- 

AGA k -1 AGAfc fc=1 j=l fc=l 

Then take {nfc}Ei = N\A and note that for this sequence conditions (THT) hold. 
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Now choose any subsequence {n/ c }^ 1 satisfying conditions (fill) . Then 

^ - > 0 , 

hn k bn k — l 

hence a nk = o(b nk ), which proves the lemma. □ 

We will use the following lemma (see Lemma 2.3 from [7]) to investigate 
convergence and the rate of approximation of the AWCGA. 

Lemma C. Let X be a uniformly smooth Banach space with the modulus of 
smoothness p(u) and T> be any dictionary. Take a number e > 0 and two 
elements f and f e from X such that \\f — f e \\ < e and f e /A £ A\(T>) with some 
number A = A(e) > 0. Then for the AWCGA with a weakness sequence {t n }^Li, 
a perturbation sequence {5 n } c ^ = o, and a bounded error sequence 


En+l < "/nil inf (l + 5 n '” +1 (i + 2 P ( ^ ) ) 

for any n > 0, where 

a _ 5n + Vn + 2 p {p(2 + rj n ) ll/ll) 

Pn — inf 

M>0 p 

We are now ready to prove Theorem [I] Note that the proof of sufficiency 
follows closely the proof of Theorem m given in |7j. One can acquire it by 
applying the estimates in Theorem [Bl only for indices {nk}^ =1 instead of every 
index n £ N. We present it here for completeness. 

Proof of Theorem QJ First we prove the sufficiency of conditions ([9]) (fill) . As¬ 
sume that for some f £ X the AWCGA of / does not converge to /, i.e. 
lim E n = a for some 0 < a < ||/||. Then for any n > 0 

n—> oo 


u<E n < \\f n \\. 


(15) 


Take e = a/2 and find such element f e £ X and number A > 0 that ||/ — / e j| < e 
and f e /A £ A\(V). Let be a subsequence, for which assumptions of 

the theorem hold. Then by Lemma [C] 


E nk +1 < WfnJ inf 


1 + S n . — 


At 


nk + l 


A 


1 - Sr, 


Pn k + Ot/2 \ 

WfnJ ) 



where 


Pn k = inf 
0 


Sn k ~b rjn k T 2 p ( p(2 T r/ nk ) ||/||) 
P 


We first estimate /3 nk . Using condition p(u) < "/u q we obtain 


Pn k < inf (2 7 ((2 + r ?0 ) \\f\\) q p q 1 + (6 nk + r) nk ) p x ) . 
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Consider the real valued function p{x) = ax q 1 + bx 1 . Then 


inf <p(x) = <p 
x>0 


i(q - 1) 



= p(q-l) 1/q a 1/q b 1/p 


and therefore 


Pn k < p(2'y{q - l)) 1/q {2 + q 0 ) \\f\\ ( S nic + r]n k ) 1/p = c(S Uk +Vn k ) 1,p , 

where c = p(2'y(q — 1)) 1/,|? (2 + rjo) ll/ll- Then, applying estimates p[u ) < yu 9 
and (flbl) . we get 


En k + 1 < \\fn k \\ inf + s nk - Xtn ^ +1 0 - S nk - ^ (Sn k + Pn k ) 1/P ^j + 2 7^^) • 
Consider the real valued function = ax q — bx. Then 

/ / h \V(M)\ 

inf i/j( x) = [ ( — ) ) = — (<7 — l)g p a p / q b p . 

x>0 \\aqj I 


Thus 

En k +1 A 11/ n k || (l + &n k — -®*/n fe +l) > 

where B k = (q - l)q- p (2'i)~ p / q A~ p ((§ - S„ k ) a - c(6 nk + Vn k ) 1/P Y ■ Hence 
the estimate E Uk < E nk+ 1 and condition (J3J) provide 

En k+ 1 7 E nk (\ + Pn k ) (l + bn k ~ -®s/n fc + l) . 

Note that B k > 0 for sufficiently big k since conditions m and (fill) imply 
S nk —> 0 and ri nk —» 0. Assume without loss of generality that B k > B > 0 for 
all k £ N with some constant B > 0. Then 

En k+1 is E nk {l + r}n h ) (l + 5 nk — Bt^ k+1 ) • (16) 

We show that B < 1. It is easy to see that the definition of the modulus of 
smoothness |3]) implies u — 1 < p(u) < yu 9 , hence 7 > 2~ q . Then, taking into 
account that 

A > H/1 > ll/ll-f>^, 

we obtain 

B<B k = {q - l)q- p (2 1 y p l q A- p (Q - S n Yj a - c(<5„ fe + Vnk ) 1/p J 
<(q-l)q- p (2 1 )- p / q A- p {^y 
< (q- l)q- p (2'y)~ p / q < 2 ( 1 - -) < 1 . 
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Therefore l + 5 nk - Bt p nk+1 > 0 and recursively applying estimate m provides 


Bn k+ 1 < ll/ll JJ(1 + Vnj ) + 8 nj Bt p n . + ^J 

j =i 
k 

< ll/ll n ( X + 5n i + - Bt nj+ 1) < a 

J=1 

for sufficiently big k by assumptions 

OO 

S n k = o(t p nk+1 ), r] nk = o{t p nk+1 ), and J2t p nk+1 = oo. 

k =1 

Hence E Uk < a, which contradicts the assumption lim .E n = a. Therefore 

+ n—»oo 

lim E n = 0 and by © 

n—> oo 

11 fn 11 < (1 + Vn)B n < (1 + rjo)E n —* 0, 
i.e. the AWCGA of / converges to /. 

Now we prove the necessity of conditions © CEU). Assume that for any 
subsequence {nk}^L 1 at least one of the statements 

OO 

Ec+i <°°’ 

fc =i 

7^ °(C + l)’ 

Vn k 7^ o(t£ fc+1 ), 

holds. We construct an example of a Banach space, a dictionary, and an element, 
for which the AWCGA with any weakness, perturbation, and error sequences, 
satisfying the stated assumption, does not converge. 

For a number a > 0 define sets Ai = {rt 6 N : d„_i > at? or ry n _i > at?} and 
A 2 = N \ Ai. We claim that there exists an a > 0 such that 

< 00 ■ ( 17 ) 

jeA 2 

Indeed, if = 00 f° r an Y a > 0 then for every k > 1 choose a{k) = 2 _fc , 

te a 2 

and find T*, C A 2 (fc) such that min{?r : n £ T^.} > max{n : n £ Tfe_i}, 

OO 

max{n : n £ T*,} < 00 , and t p > 1. Hence by considering the union (J F^, 

jer k _ fc =1 

we receive the sequence for which conditions © (nn» hold, which contradicts 
the aforementioned assumption. 

Take any 1 < q < 2 and let X = £ q , and let V = {±e„}^l 0 , where {e„}^l 0 
is a standard basis in £ q . Fix an a > 0 such that claim OH holds, and find 
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corresponding sets Ai and A 2 . 

OO OO . 

If | Ai| < 00 then J 2 t P < 00 ■ I 11 this case it is known that for / = e0+ X] 9 e j 

n=1 j =1 

the WCGA (and therefore the AWCGA) does not converge to / (see Proposi¬ 
tion 2.1 from 0 ). 

Consider the case |Ai| = 00 . Without loss of generality assume that 1 G A 2 . 
Choose a nonnegative sequence {a 3 }j & Ai such that ^ a q = 1 and a 3 < a 1//? 

je Ai 


for any j G Ai, and take 


/ = 


E 

jeAi. 


(i j e j T o 


1/9 


E fv 

j 6A 2 


We claim that there exists a realization of the AWCGA of / such that for any 
n > 1 

/n = ''lEei + E a i e j +« 1/9 E ( 1S ) 

ieAi teA^ n> 

where Aj 1 ' = A 2 \ T n , and T n is a set of indices of e,j chosen on the first n steps 
of the algorithm. 

For n = 1 choose 


F 0 (x) = F f (x) 


E a q / p Xj + a 1/p J2 tjXj 

Ai je a 2 



Then 


+o( e o) — 0, 

+o( e j) = a q/p \\f\\~ q/p < a 1/p \\f\\~ q/p for any j G A lt 
Fo (ej) = t 3 a 1/p \\f\\~ q/p for any j G A 2 . 

Therefore the choice </>i = ei is possible since 1 G A 2 . Thus Ti = {1} and taking 

fi = vl /Q e 1 + J2 a i e i + al ' q E tf /qe i 


j€Ai 

\ 1/9 

jgA' 15 

satisfies (J3]) since E\ = ( 1 + a V t p 1 

> 1 and 

V ieA' 15 




/ 


II 

+ 

i+« E <? 


V 

j'eA^ / 

< (1 + % )E q 



< (1 + Vi) q El 
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Hence for n = 1 claim (TTH1) holds. 

For n > 1, provided f n -i= rin-i e i+ E o-jej+a x ! q E tj e A choosing 

jeAi jeA^ n_1) 


^1^0 + Vn-iXi + E a q / p Xj+aV p E t . 


i/p 


F n -i(x) = 
satisfies |T]) since 


i6Ai 


i/P n 

'3 x 3 


A/P 


je a; 


(«—i) 


' '3^3 


(l + Sn-tf/r Wfn-X fj p 




Sn-1 + Pin -1 + E a ? + Ot E 


| J F„_i(ar)| < 
and 

F n -l(f n -l) = 


je A± 


je a: 


(n-l) 



1/9 


E*3 


3=0 


(1 + <5n- 1 ) 1 / p ||/n- 1 ||g/ P 


< 11 * 11 , 


1/n-l + E <4 + a E 


3 6 A x 


j£a; 


(n-1) 


ll/n-il 


> (1 — <5n-l) ||/n-l 


(l + ^_r)V P !!/„_! ||f> (l + Jn-rjVP 

where the last inequality uses the estimate 

(1 + 5 n _i)VP(l - <5„_i) = (1 - <5Ei) 1/p (1 - d„_i) 1/9 < 1. 

Hence such choice of a functional is possible. Let A n = ^(1 + <5„_i) ||/ n -i||^ 
Then 


-i/p 


Fh-i(eo) — &^/—i A n , 

K-i(ei) = 7?y_ p i3l„, 

F n -i(ej) = a q/p A n < a 1/p A n for any j G Ai, 

F n -i(ej) = tja 1/p A n for any j G A^ l_1) , 

F„_i(ej) = 0 for any j G T„_i \ {1}. 

If n G A 2 we choose <j> n = e n . Otherwise bG Ai, and either 

F n _i(e 0 ) > t n a 1/p A n and/or F„_i(ei) > t n a 1/p A n . 

Therefore it is possible to choose <j> n = eo or <p n = e\ . In any case T n (~l Ai = 0 
and taking 

fn = P) 1 J q e 1 + a i e i + “ 1/? 

ieAi jeA^ n) 
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1/9 


satisfies ([3j since E n = \ 1 + a I > 1 and 


je A. 


(») 




1 + a £ tj 

\ jeA< n) 

< (1 + l?n)-E® 

<(l+r?„)^. 

Hence claim (fl8l) holds for any n > 1. Thus ||/„|| 0 and the AWCGA does 

not converge to /. □ 

The next corollary gives the particular rates for the weakness, perturbation, 
and error sequences, which are sufficient for convergence. 


Corollary 2.1. Let X £ V q be a Banach space and T> be any dictionary. Let 
{t n }™ =1 , {h„}^L 0 , and {r] n }n Li be any such sequences that for some subsequence 

MZi 

t nk x k 1/p , S nk x k r , and r] nic x k s , 

where p = q/{q— 1) and r,s > 1. Then the AWCGA with the weakness sequence 
{/„}“Li> the perturbation sequence {(>n}^Lo’ an h the bounded error sequence 
{r?„}~i converges for any f £ X. 

We now justify the restriction imposed on an error sequence in Theorem [Q 
The following proposition demonstrates that if an error sequence is unbounded, 
then for any 1 < q < 2 there exists a dictionary T> and an element / in £ q such 
that the AWCGA of / diverges. 

Proposition 2. For any {r]n}^Li with limsup? 7 n = oo and any 1 < q < 2 

n—too 

there exists a dictionary T> in £ q and an element f £ t q such that AWCGA of 
f with any weakness sequence {t n }“L 1; any perturbation sequence and 

the error sequence { 17 ™}^=! does not converge to f. 

Proof. Let V = {±e n where { e n }^° =1 is a standard basis in £ q . Choose any 

weakness sequence {f„}“Lii a perturbation sequence {£„}^L 0 and find a subse¬ 
quence {rik^^kLi such that r] nk > k for any k > 1. Take a positive nonincreasing 

OO 

sequence {aj}^L 1 £ £ q such that ^2 a< j = 1 an d 

3 =1 



1/9 

> (k + l)' 1 


OO 

for any k > 1. Denote f = a i e o e ^ 9 - 

3 = 1 

Consider the following realization of the AWCGA of /: 
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For n $ choose <j> n = e n and G n = Y2 a j e j- 

j = 1 

For n £ {nk}^-i choose 4> n = e n and G n = 0. 

Then for any k > 1 norm of the remainder ||/ n J| = ||/||, hence ||/„|| -/> 0. □ 

The following lemma is used to prove Theorem [3] 

Lemma 2. Let {oL n }Y =l and {b n }Y =1 be any such nonnegative sequences that 

OO CO 

E an < OO and E b n = oo. 

n= 1 n= 1 

Then there exists a subsequence {nk}^ = i such that 

CO 

= OO and a nk = o(b nk ). 

k =1 

Proof. Take Tj C N - the set of all such indices A G N that a a = 0. If 
Y2 b\ = oo, then |Fo| = oo, and = To is a required subsequence. 

Aer 0 

Consider the case J2 b\ < oo. Take Ti C N - the set of all such indices A £ N 
Aer 0 

CO 

that 1^- > 1 or 6 a = 0. Therefore J2 b\ < °a < J2 a n < oo. 

x Aeri Aer x n=i 

Set Aq = Fq U Ti. Then 


22 b\ < bx + b\ < oo. 

AgAq AgTo AgTi 

For each k £N denote by A*, C N \ A 0 the set of all such indices A £ N that 


Note that for any k £ N 


1 

k + 1 


< — < 1 . 

b\ ~ k 


(19) 


OO 

J2 b x<{k + l)J2 a ^< ( k + !) E a n < oo, 

AgA^ AgA/j ti=1 


which implies that infinitely many sets are not empty and N = (J A&. Thus 

k—0 


E E 6 a = ( 2 °) 

fc=iAeA fe 

For each k £ N choose SI a, C A& such that 

|f2fc| < oo and E ^ E 

Aefi fc AeA fc 
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We claim that subsequence {rife}^ =1 = (J fife satisfies the requirements. Indeed, 

fc =1 

by the choice of fife and from (P2U1) 

OO OO 1 oo 

k—1 k— 1 k= 1AGAfc 

hence the first requirement is satisfied. We show that a nfe = o(b nic ). Choose any 
0 < e < 1 and find m G N such that 


— \ C ^ -. 

m + 1 m 

Then for any k > max {a>j} by (USD 

1<_7 <m 


^ n k ^ ^ 

7^ - —TT < c > 

o„ fc m + 1 

hence the second requirement is satisfied. □ 

3 Rate of convergence of the AWCGA 

In conclusion, we discuss the rate of convergence of the AWCGA. It is clear that 
in order to get a nontrivial rate of approximation, an additional requirement 
has to be imposed on an element. Traditionally for this area, we restrict to the 
elements from the class Ai(V) - the closure of the convex hull of V. We start 
with the known result for the rate of convergence of the WCGA (see Theorem 2.2 
from 0 ). 

Theorem D. Let X G V q be a Banach space and T> be any dictionary. Let 
{trbe a weakness sequence. Then for any f G Ai(V) the AWCGA satisfies 
the estimate 

{ n \ ~ 1 /P 

\\fn\\ < C (l + X^fcJ ’ ( 21 ) 

where p = q/(q — 1) and C = C(q : 7 ). 

The next result states the rate of convergence of an adaptive AWCGA, where 
adaptive means that perturbation and error sequences are determined by the 
AWCGA applied to a given element / £ Ai(V) (see Theorem 2.4 from [7]). 

Theorem E. Let X G V q be a Banach space and T> be any dictionary. Let 
{tr i}^Li be a weakness sequence. Then for any f G Ai(V) the AWCGA with 
the perturbation sequence {c>n}^Lo and the error sequence {r] n }^- 1 > which are 




given by 


n> 0; 


( 22 ) 

(23) 


*n = Cill/nir 3-P (64(8 7 ) p/9 ) 

Vn = t p n+1 EP 3~ p (64 (8 7 ) p/9 ^ , n > 1, 

where p = q/(q — 1), satisfies the estimate 


II/nil < C 



-1/p 


w/iere C = C(q , 7 ). 

The particular advantage of this result is that the rate of convergence of the 
AWCGA with such perturbation and error sequences is the same as the rate of 
convergence of the WCGA GT1) . 

We prove the following theorem, which is essentially Theorem [E] but with con¬ 
ditions (1^1) and (E3l) imposed only on some subsequence {nk}^f 1 - The proof 
we give here is basically the proof of Theorem 2.4 from |7j with some minor 
distinctions. 

Theorem 4. Let X £ V q be a Banach space and T> be any dictionary. Let 
{t n }^Li be a weakness sequence. Then for any f £ A\(V) the AWCGA with a 
perturbation sequence {S n } n= 0 and a bounded error sequence {p n } n —i such that 
for some subsequence 

^ = C+1 II/™, f 3- p (64 (8 7 ) p/9 ) *, k > 1; (24) 

Vn k = t p nk+1 E p k 3~P (64 (8 7 ) p/9 ) , k > 1, (25) 

where p = q/(q — 1), satisfies the estimate 

( N 

ll/J<c l + £ ts, 

\ fe =1 

where C = C(q 7 7 , po) = 8(1 + po)”/ 1 ^ and N = N(n) = max{/c £ N | nk < n}. 

Note that once a subsequence {nk}^L 1 , for which conditions (l24l) and (1251) 
hold, is found, only the choice of elements (f> nk is essential for the rate of con¬ 
vergence, so arbitrary elements (pj can be chosen on other steps. 

Proof of Theorem Take any f £ A\(V). Then Lemma [C] applied with the 
subsequence provides with e = 0 and A = 1 

E nk+1 < \\f n J inf (l + - A t nk+1 (l - - |^) + 2 p (pj,)) - 
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where 


= inf 

M>0 


3n k + Vn k + 2 p (p(2 + T) nk ) 


Note that since ||/|j < 1 and 7 > 2 q 


Vn k <3-p(64(8 2“T /9 ) 
6n k <(l+Vn k ) p 3- p (64(8 2 -“r /q ) 


1 1 

3 ) 88 ^ < 2’ 


- 1 1 1 
88 ? < 16' 


Hence, using an estimate p{u) < 7 u q , and taking p = || f„ k \\ p ^ q 3 p ( 4 ( 87 ) P//? ) 
we obtain 

Pn k < (Sn k +r) nk ) p- 1 +2 1 p q - 1 (2 + Pn k ) q ||/H'' 


— jg II fn k || + 


^) q \\fn k \\<- 8 \\U 


Thus, since p{u) < 7 u q and S nk < 1/16, 

En k+1 < Wfn k \\ inf (1 + 8n k - \t nk+l + 2 7 A 9 II/, 


A>0 


16 


Take A = C(+i \\fn k || P ( 87 ) p ^ q - Then using ([3]) and conditions (l24l) we get 


En k+ 1 < || fn k ||(l+ 8n k 


5 ^n k +1 ll/"fc 

16 (87 )p/i 


<11/,. II 


4(87 )p/« 


— En k I 1 


fP fTP \ / fP pp \ 

b n k +l- L ^n k \ , _ , '7n. + l xv rn ; \ , p _ ,p \ 

3 p 64(87) p / 9 y \ 4 ( 87 )^ / ” fc ^ " fc+1 nk ' ’ 


where a = ( 8 ( 87 )^) \ Then, since x p < x for 0 < x < 1 , 

E P k+1 <E p k (l-at p nk+1 E p k ). (26) 

Using the technique from Lemma 2.16 from [ 8 |, we will show that for any m > 0 

/ m \ ~ 1 /P 

En m <a- 1 / p ll + Y^t p k J . (27) 

We use induction by m to prove (EH). First, note that a < 1 since 7 > 2 q . 
Then for m = 0 

E 0 = ll/ll < 1 < a“ 1/p , 

hence the estimate holds. Assume that it holds for m. Then inequality 
provides 

E~ p +1 > E~ p (1 - < m+ 1 ££j _1 > E~ p (1 + at p nm+1 E p J 

/ m +1 \ 

= E ~ p + at p nm+1 > a f 1 + ^ t p nk J , 
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since by the assumption estimate (1271) holds for m. Thus the induction holds 
and estimate (EH is correct for any m > 0. Then by m 


i N 

II/n|| < (1 + r] n )E n < (1 + ‘q n )E nN < C ( 1 + ^ t p nk 

V fc= l 

where C = (1 + r]o)a~ 1 ^ p = 8(1 + rjo) r y 1 / q . □ 

The following corollary shows that the AWCGA will converge with the same 
rate as the WCGA as long as adequately precise computations are made suffi¬ 
ciently often. 

Corollary 3.1. Let X E V q be a Banach space and T> be any dictionary. Let 
{^n}^o an d {^nj^i be any such sequences that for some subsequence 

M = sup |rife + i — rifc| < oo 
fee n 

tn k -\-1 ^ ^ 

Sn k <t p \\f nk r 3- p (64(87) p/9 )'\ 

Vn k <t p E p k 3~ p (b4 (8 7 ) p/9 ) 1 , 

where p = q/(q — 1). Then for any f E Ai(fD) the AWCGA with the weakness 
sequence {t n }'^Li, the perturbation sequence {c>n}^l 0 , an ^ ^ e bounded error 
sequence {r/ n }^°_i satisfies the estimate 

II/n || < Cn~ 1+1 /\ 



where C = C(q , 7 , p 0 , M). 

We also state two corollaries that give the rate of convergence of the adaptive 
AWCGA for the standard dictionary in l p spaces. 

Corollary 3.2. Let X = t q , 1 < q < 2 and T> = {±erj}^L 1; where {e„}“ =1 is a 
standard basis in £ q . Let a = E i\ be a positive nonincreasing sequence 

with ||a,||< 1. Let {t n }^Li, {^nj^Lo’ an ^ { r tn}'^Li be any such sequences that 

for some subsequence {nk}^ =1 with M = sup |nfe+i — Uk\ < 00 

feeN 


tn k +1 ^ t > 0 , 
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oo 

Then for the element f = Yh a n^n the AWCGA with the weakness sequence 

n= 1 

{t n }™ =1 , the perturbation sequence and the bounded error sequence 

satisfies the estimate 


\\fn\\ < Cn~ 1+1 '\ 


where C = C(q, t , r)o , M). 

Corollary 3.3. Let X = l q , 2 < q < oo andV = {±e n }^L 1 , where {e n }^L 1 is a 
standard basis in £ q . Let a = {a n }YLi £ £i be a positive nonincreasing sequence 
with ||a.|| : < 1. Let {t n }YLi> {bn}Y= 0 ’ and {r) n }^-i be any such sequences that 

for some subsequence with M = sup \nk+i — rik\ < oo 

ken 


trik + l h t > 0 , 


bn. l. ^ 


t z 


Irik < 


4608 

t 2 

4608 


E < 

oo 

E 

\k=n k +1 


2/q 


2 /q 


“5 


OO 

Then for the element f — Y2 a n^n the AWCGA with the weakness sequence 

n— 1 

{tn}n Li> the perturbation sequence and the bounded error sequence 

{Vn}Y=i satisfies the estimate 


II/n|| < Cn- 1 / 2 , 


where C = C(q, t, 
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